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There are common techniques for personal identification such as fingerprint 
recognition, face recognition, and iris recognition. In this paper, we suggest a 
new method for personal identification using lip print furrows. This method 
will be useful in forensics services. This study aims to identify people by their 
lip print patterns that are unique for each person. Lip print features are 


extracted from the lip print images by using the vertical Sobel operator, 
diagonal +45 lines, and hough transform. A lip print pattern was formed for 
each person containing only the furrows (the extracted features) that were 
extracted from 3 lip print images for that person. The correlation coefficients 
and the mean squared error (MSE) are provided and passed to the support 
vector machine (SVM) for the classification process. The suggested method 
gives good results. A comparison between the results of the proposed method 
and other methods was presented. 


Keywords: 


Biometric human identification 
technology 

Edge detection 

Features extraction 

Hough transform 

Lip print pattern 

Personal identification 

Support vector machine 


This is an open access article under the CC _BY-SA license. 


Corresponding Author: 


Tamara Afif Anai 

Department of Computer Science, Tikrit University 
Tikrit, Iraq 

Email: tamsamka @tu.edu.iq 


1. INTRODUCTION 

In recent years, biometric systems have become a popular method of identifying a person. Many methods 
are used to identify the person, such as the face, finger, veins, skin, iris, palm, retina, nails, and DNA [1]-[3]. 
Tsuchihasi and Suzuki reported at the University of Tokyo, from 1968 to 1971, that humans have unique lip 
features. A lip print may be used to detect crime. It can be used to trace evidence of the crime and to identify the 
person and their gender. The study of furrow patterns occurring in the human lip is called cheiloscopy [4]. In 
several countries, like Poland, lip traces are effectively used to identify criminals during investigations [5]. Lip 
print is one of the most difficult ways because the lip is soft and very flexible. The surface of the lip is formed by 
several furrows that form a network of lines. Lip prints bring large and wide benefits in various fields such as 
personal identification [6]-[9]. In 1999 in Illinois, lip print was used for personal identification of criminals [10]. 

Recently many authors in the literature analyzed and manipulate lip prints manually from the medical 
point of view as [4], [11]-[15]. In recent years, scientists have shown a large increase in this important concept. 
In general, features can be classified into texture, shape, and color. The form and position of the lip furrows were 
analyzed in texture features such as Markov models [16], radon transform [17], Bifurcation’s analysis [18], HT 
[19], Top_Hat [20], gabor filter, local binary pattern (LBP) [21], dynamic time warping (DTW) [22], [23], statical 
analysis [24], [25], scale invariant feature transform (SIFT), speeded up robust features (SURF) [26], location and 
inclination of the furrows [27], LBP, area and perimeter [28] and principal component analysis (PCA) [29]. Shape 
features include general geometric properties of the lips [30], Rotation, scale, and translation invariant image [31], 
and Shape descriptors [32]. Color features such as Moments of the color [33], histogram of the color [34]. In the 
following, we will discuss textures feature methods in the literature related to our work. Many studies in the 
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literature concerned the identification and verification of lip prints. These studies are abbreviated in Table 1. In 
this manuscript, we suggested a technique for personal identification using lip print. The method consists of three 
stages pre-processing, feature extraction, and classification. Features of lip print are extracted using diagonal line 
operator, sobel operator, canny operator, and hough transform, then support vector machine (SVM) is used for 


classification. The rest of this paper is organized as the following: section 2 presents the proposed method, results, 


and discussions were introduced in section 3, and finally, section 4 presents the conclusion. 


Table 1. A brief description of some studies of lip print identification 


Author and year 


Techniques Used 


Dataset 


Accuracy rate 


Loopholes of the Method 


Bakshi et al. [26] 


Porwik and 
Orezyk [22] 
Bhattacharjee 
et al. [24] 


Wrobel et al. [19] 


Wrobel et al. [18] 


Wrobel et al. [27] 


Roshan et al. [28] 


SIFT and SURF techniques 


DTW and voting system 


The statistical method used 
to find the average direction 
of groves (horizontal, 
vertical, and diagonal) used 
edge detection 

GHT, and the line segments 
used three parameters (The 
length, the angle of 
inclination to the X-axis, and 
the location of the midpoint 
of the section) as features 
Bifurcation analysis 


Creation of lip pattern 


LBP are used to obtain 
texture-based features from 
the segmentation process 
upper and lower lip 


Lip images are captured 
by Canon PowerShot 
A1100IS camera in 
constrained illumination 
avoiding reflection of 
surrounding light on the 
lip. 
http://biometrics.us.edu.pl 


http://biometrics.us.edu.pl 


The lip print images are 
converted into a digital 
form using a scanner with 
a resolution of 300 dpi. 


http://biometrics.us.edu.pl 


http://biometrics.us.edu.pl 


http://biometrics.us.edu.pl 


>90% 


88.5% 


96% 


85.1% 


711% 


92.73% 


97%, 85.8%, 
81.84%, and 
80%. 


This algorithm uses regular 
images only. 


This algorithm requires high- 
quality lip print images. 
Using only 20 images 


The location of the midpoint of 
the section is maybe changed 
because the lip is very soft which 
affects the accuracy 


The error rate was 23%. In their 
method some pixels imitated 
bifurcations that did not exist in 
the lip print pattern. 

They used two techniques one 
for high quality images and the 
other for low-quality images. 
They used the shape features in 
lip print which are changed with 
opening or closing the mouth. 


2. METHOD 


The proposed method involves three cascaded stages (pre-processing, features extraction, and 


classification). The Pre-processing has executed the following steps converting test images to grayscale 
images, region of interest, thresholding, and smoothing images. In the features extraction stage, it is executed 
the following steps are furrow's detection and HT. SVM using in the classification stage. Figure 1 shows the 
block diagram of the proposed method. 


Features Extraction 


Diagonal line 
operator 
Vertical 

Sobel 
operator & 
(Canny 


Lip 
classification 
SVM 


Pre- 


Qe operator) 


Hough 
Transform 


Figure 1. Block diagram of the proposed method 
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2.1. Pre-processing stage 
2.1.1. Pre-processing stage 1: converting test images to grayscale images 

The test images are colored images. It is converted into greyscale images. Cropping the image around 
the lip print to remove unnecessary areas. This procedure reduces the area that should be focused on for this work. 
Figure 2 shows an example image fors lip print. Topographically in [3], was divided the lip print into six parts; 
each lip has three zones: upper right (UR), upper middle (UM), upper left (UL), lower left (LL), lower middle 
(LM), and lower right (LR), as shown in Figure 3. In this study, (LM) part of the lip print was selected manually 
as a region of interest and used in the experimental testing because the lines of features are clear and visible [10]. 


. — 
Lip Furrows 


Figure 2. Lip print image with simple furrows —_ Figure 3. Topographic subdivisions of lips into six 
parts: UR, UM, UL, LL, LM, and LR 


2.1.2. Pre-processing stage 2: region of interest 

Select the lower middle part of the lip for three lip print images for each person. The selected part of 
all the images had the same size (65x80) pixels. Figure 4 shows the interesting region in the original images, 
Figure 4(a) shows the original three lip print images for a person, and Figure 4(b) shows the selected lower 
middle part of each lip. 


(b) 


Figure 4. Shows the interesting region in the original images (a) the original three lip print images for a 
person and (b) lower middle lip with crop part equal 65*80 pixels 


2.1.3. Pre-processing stage 3: thresholding 

The thresholding process is used to separate the background from the object [35]. Figure 5 shows the 
three lip prints after thresholding, using Otsu's method. Figure 5(a) The three lip prints after converting to 
grayscale and selecting the lower middle lip, and Figure 5(b) the three lip prints after thresholding. 


(a) 


(b) 


Figure 5. A thresholded stage for lip prints (a) the three lip prints after conversion into grayscale and select 
lower middle lip and (b) the three lip prints after thresholding 
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2.1.4. Pre-processing stage 4: smoothing 

Gaussian smoothing is used to smooth lip prints. Figure 6 shows the lip prints after passing through 
the Gaussian 3x3 filter. Smoothing is performed frequently four times to reduce all the noises in the images and 
to find only the major furrows of the lip prints [36] a Gaussian filter can be described as in (1). 


Gauss[a(x,y),o] = 1/270? exp(—(x? + y?)) /20? (1) 


Where a (x, y) is the original image, and o =0.5. 


Figure 6. The three lip print images after applying the Gaussian filter 


2.2. Feature extraction stage 
2.2.1. Furrows detection 

The furrows are detected by applying the operator’s matrices as Figure 7. In Figure 7(a) diagonal line 
operator +45, Figure 7(b) diagonal line operator -45, and Figure 7(c) vertical Sobel operator. Then the three 
images are combined in one image. This image displays all features of the original image, as in (2). This 
equation is performed on each lip print image for a person. Finally apply the Canny Operators. The main reason 
to use a Sobel operator before the Canny operator is that the Sobel operator is used for image segmentation, it 
is running in a vertical direction and it is less sensitive to noise, while the Canny operator is used for image 
enhancement, and it is sensitive to the weak edge. In our study, the Canny edge detector is implemented on the 
result of Icom(x, y)as in (2). Figure 8 shows a sample implementing these operators on lip prints for a person 
in Figure 8(a) the three-lip prints applying diagonal line +45, Figure 8(b) the three-lip prints applying diagonal 
line -45, Figure 8(c) the three lip prints applying vertical Sobel operator, Figure 8(d) the result of combined the 
three operators for a lip, and Figure 8(e) applying a Canny edge detector in the result of the combined three 
operators for a lip. The following steps are used to combine lip print features into one image as described. 


Input: Suppose a(x,y) //represents the region of interest of the lip print image after executing preprocessing 
stage on it. 

Output: Icom(x,y) // The image that combine all the features for a person. 

Initialization: 

Step 1: for j=1 to number of lip print for a person // number of lip print for a person 

Step 2: apply diagonal mask + 45 lines on a(x,y) as shown in Figure 8(a) // call it d1[a(x,y)] 

Step 3: apply diagonal mask - 45 lines on a(x,y) as shown in Figure 8(b) // call it d2[a(x,y)] 

Step 4: apply Vertical lines using Sobel operator on a(x,y) as shown in Figure 8(c)// call it VS[a(x,y)] 

Step 5: union of results of Steps 2,3 and 4 to perform Icom(x,y) as shown in Figure 8(d) // this image gathers 
all features using the equation is given by (2). 

Step 6: end (For) 


Figure 7. The operator’s matrices (a) diagonal line +45, (b) diagonal line -45, and (c) vertical Sobel operator 


Icom(x, y) = {d1[a(x, y)] U d2[a(x,y) UVS[a(x,y)]} (2) 
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Where: Icom(x, y) is the image, which combined the features from steps (a, b, and c) a(x,y) is the lip print 
region of interest after applying preprocessing stage for a person, dl a(x,y) diagonal lines+ 45, d2 a(x,y) 
diagonal lines -45, and VS a(x,y) is the extracted vertical lines using Sobel operator. 


Figure 8. An implementation of the furrows detection: (a) the three-lip prints applying diagonal line +45, 
(b) the three-lip prints applying diagonal line -45, (c) the three lip prints applying vertical Sobel operator, 
(d) the result of combined the three operators for a lip, and (e) applying a Canny edge detector in the result of 
the combined three operators for a lip 


2.2.2. Hough transform 
Paul hough published the (HT) in 1962. HT is used to detect geometric objects in images (e.g., straight 
lines, circles, or ellipses) [37]. In this paper, HT is used to detect straight lines. It is applied on the images 
results from applying the Canny operator. Based on cartesian coordinates (x, y), the length of the vector r for 
each angle 0 value is calculated according to (3). The aim of using HT is to extract a collection of the straight 
lines, which represent a furrow in lip print. Figure 9 is selected straight lines detected using HT for three lip 
print images. 


r = xcos @ + ysin 0 (3) 


Where: -90° <= @ <= 90°. 


Figure 9. Shows a graphical analysis of straight lines detected using HT, in which vertical lines are 
selected only 


2.3. Classification stage 
To obtain the pattern for a person from the features extracted from three lip prints can use the in (4). 
Figure 10 is shown an example of the pattern. The correlation coefficients between the pattern and the lip print 
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features are stored in an accumulator array. We get the maximum value in the accumulator array when the 
pattern correlates with the same person's lip prints and calculate the mean-squared error (MSE) between the 
pattern and lip print features. Then correlation coefficients and MSE of features are passed into SVM to 
classify the dataset. Cross-validation is used to distribute the Training set and Testing set by the Holdout 
Method. This paper also shows that a lip print identification based on SVM classification can be satisfied in 
two classes to identify the person. 


2 
2 


1 if HT,(x,y) + HT,(x%, y) + HT3(x,y) 


Ipaemeay) = t if HT,(xy) + HT,(x,y) + HT;(%y) (4) 


= 
< 
Where: Ipattern(x, y) is the pattern image for the person. HT (x,y), HT2 (x,y), and HT3 (x,y) are the gathers 
of all the features for image 1, image 2, and image 3 respectively for the same person (since we have 3 images 
for each person). (i.e., the pixel in the pattern equals one if at least the pixels in two lip prints feature 
images=1). 


Figure 10. The pattern for a person from the features extracted from three lip prints 


3. RESULTS AND DISCUSSIONS 
3.1. Dataset 

The lip print test images used in this study are taken from two websites [38], [39]. The sample of the 
lip print test images taken from [38] consists of 60 lip print images (15 persons,4 lip print images for each 
person, the gender is unknown in this dataset). While data sample of lip print test images given in [39] consists 
of 88 lip print images (22 persons, 4 lip print images for each person, 9 males, and 13 females). The total 
number of images used in this study is 148 lip print images (37 persons, 4 lip print images) in our study we 
used only 3 lip prints to create the patterns. 


3.2. Results and discussions 

The proposed algorithm was implemented using MATLAB R2013a. The performance of the 
classification algorithm is measured using different metrics, the statistical metrics defined in Table 2, such as 
accuracy, which is the probability of performing a correct classification; error rate, sensitivity which is the 
proportion of actual positive cases that are correctly identified; specificity, which is the proportion of actual 
negative cases that are correctly identified, and precision which is the closeness of the measurements to each 
other. The classification produces four types of outcomes-two types of correct classification, true positives 
(TP), which is the number of observations to which the model correctly assigns true values, and true negatives 
(TN), which is the number of observations to which the model correctly assigns false values, and two types of 
incorrect (or false) classification, false positives (FP) which is the number of observations to which the model 
incorrectly assigns true values since their actual values are false, and false negatives (FN) which is the number 
of observations to which the model incorrectly assigns false values since their actual values are true. 

In our study we used SVM to classify whether a lip print image is for a specific person or not. The 
instances in each dataset are randomly divided into two sets: 75% as the training set and 25% as the testing set. 
The average of 20 repeated runs for each person gives the performance. The results of measuring values are 
shown in Table 3. The proposed method is compared with the other methods, the results have been divided in 
two tables in Table 4 which are used the dataset in [38], and Table 5 methods which used different dataset. The 
details of the comparisons are as follows: 

— The proposed method gives a better result, as shown in Table 4, in which the average accuracy rate equals 
93.6%. The proposed method gives better accuracy than most other methods except for the Statistical method 
[24], which gives better accuracy, but this may be because it relies on a small sample of only 20 images. 

— According to the results shown in Table 5, in [21], [26] the source of the dataset is unknown. The proposed 
method gives the high accuracy using two datasets in [38], [39] comparisons with methods in Table 5. 
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Table 2. Classification of performance 
Measures Formula 
Accuracy (TP + TN) / (TP + TN + FN + FP) 
Error rate (FP + FN) / (TP + TN + FN + FP) 
Sensitivity TP / (TP + FN) 
Specificity TN / (TN + FP) 
Precision TP / (TP + FP) 
Table 3. Performance the proposed method 
Dataset Accuracy rate _Errorrate Sensitivity rate _ Specificity rate _ Precision rate | Average Time. sec. 
[38] 93.6% 6.4% 98.64% 23% 94.78% 16.54 
[39] 91.94% 8.06% 96.1% 4.55% 95.5% 21.60 
Table 4. Comparison of the proposed method with other methods using dataset in [38] 
Methods Accuracy The No. of Lip Print Images Details of Methods 
rate Used in the Study 
Proposed method 93.6% 60 lip prints obtained from 15 -Sobel operator, Canny operator, HT, and SVM 
person (4 prints per person) 
The algorithm in [27] 92.7% 350 lip prints obtained from 50 -Creation of lip patterns, SHT, length of furrow, 
people (7 prints per person) and classification (KNN, Ridor, J48, Hoeffiding 
Tree, KStar) 
Statistical method 96% 20 lip prints from 4 persons -Edge detection Technique, performance 
[24] (FAR, FRR, and ROC) 
Bifurcation analysis 71.0% 120 lip prints obtained from 30 -Bifurcation methods-similarity coefficient 
[18] people (4 prints per person) 
Section Compari-son 85.1% 45 lip prints were obtained from —_-HT - similarity coefficient 
[19] 15 people (3 prints per person) 
DTW algorithm + 88.5% 120 lip prints obtained from 30 -DTW and voting and rank technique-performed 
Voting system [22] people (4 prints per person) using the histogram and CMC curve-EER 
DTW algorithm [23] 78.8% 120 lip prints obtained from 30 -DTW -lip pattern image projections: horizontal, 
people (4 prints per person) vertical, and oblique (angle of 45° and 135°). 
ROI+ cross- 93% 120 lip prints obtained from 30 -ROI was determined in the image, then the 


correlation [40] 


people (4 prints per person) 


standardized cross-correlation method, for 


performance (FAR, and FRR curves for different 
recognition) 


Table 5. Comparative of the proposed method with other methods whose dataset source is unknown 


Methods Accuracy rate Dataset Description Details of Methods 
Proposed Method 93.6% (4 prints per person) (60 lip prints) [38], Sobel operator, Canny operator, HT, 
91.94% (88 lip prints) [39] and SVM 
Gabor +LBP [21] 86.7% 100 lip prints Gabor and LBP-SVM 
PCA [21] 56.1% --- PCA 
LDA [21] 57.2% --- LDA 
Gabor [21] 81.2% --- Gabor 
LBP [21] 80.6% --- LBP 
(SIFT) [26] 93% 23 lip prints were obtained from 10 SIFT and SURF methods —performance 
(SURF) [26] 94% people FAR and FRR 


4. CONCLUSIONS 

This paper presents a new method for personal identification based on lip print patterns, which can 
be used in the forensic domain. In this study, three lip print images for each person were used to prepare a 
pattern. The proposed method is compared with a set of methods, and the results are promising. We have 
gotten a high accuracy (93.6% and 91.94%) in two different datasets. In future works, we will use a meta- 
heuristic search or hybrid search in the features selection stage to show its effect on the performance of the 
classification method. 
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